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KXBcnrivs  somnary 


RROB1.BC 

The  military's  current  focus  on  Crisis  And  Limited  Objective  Warfare  (CALOW) 
environments  demands  that  operational  personnel  be  prepared  to  rapidly  process 
and  synthesise  large  amounts  of  dynamic  data  in  order  to  meet  threats  on 
potentially  short  notice.  However,  when  the  amount  of  data  that  must  be 
processed  exceeds  an  individual's  information  processing  capacity,  decision 
making  performance  may  falter. 

PURPOSB 

To  address  this  problem,  the  Office  of  Naval  Technology  (ONT)  initiated  a 
program  of  research  known  as  TActical  decision  leaking  Qnder  £tress  (TADMUS)  .  The 
intent  of  the  program  is  to  develop  principles,  guidelines,  and  instructional 
strategies  geared  toward  reducing  performauice  decrements  in  stressful 
environments.  This  report  describes  one  component  of  the  TADMDS  effort  which 
involved  the  development  of  a  performance  assessment  task  for  researching 
tactical  decision  making  performance  in  the  laboratory.  That  task  is  the 
TActical  fiavy  Dgcision  {jaking  System  (TANDEMS) . 

APPROACH 

Based  on  extensive  interviews  and  observations  of  actual  Combat  Information 
Centers  (CICs)  ,  a  subset  of  functions  was  selected  for  simulation.  The  selection 
process  was  guided  by  several  factors:  eventual  experimental  needs,  realism, 
cognitive  requirements,  and  representativeness.  Functions  characteristic  of  CZC 
environments  vary  across  platforms  and  mission  areas;  however,  all  surface 
combatants  operate  under  a  "doctrine"  which  mandates  that  certain  functions  be 
performed  regardless  of  platform  type.  These  fijnctions  include  detection, 
tracking,  identification,  action,  and  battle  damage  assessment.  Three  of  these 
functions  -  detection,  identification,  and  action  -  were  selected  as 
representative  samples  of  the  types  of  tasks  performed  within  all  CICs  and  were 
incorporated  within  TANDEMS. 

SYSTEM  DESCRIPTION 

TANDEMS  was  designed  and  developed  by  the  Naval  Training  Systems  Center  and 
runs  on  an  IBM- compatible  personal  computer.  Users  view  a  "radar"  display  on  the 
left  side  of  the  PC  monitor.  Located  on  this  display  are  radar  contacts  of 
unknown  type  and  classification.  On  the  right  side  of  the  monitor  are  several 
menus  that  the  user  may  access  by  manipulating  a  trac)^all.  Accessing  and 
reviewing  information  within  these  menus  allows  the  user  to  determine  each  radar 
contact's  type  (aircraft,  surface  ship,  or  submarine)  as  well  as  its 
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classification  (friendly  or  hostile)  .  By  reviewing  the  information  in  the  menus, 
the  user  will  be  in  a  position  to  identify  and  act  upon  each  contact  by  labeling 
it  and  then  performing  a  final  engagement.  The  system  provides  the  user  with 
performance  feedbac)c  emd  also  automatically  records  performance  for  subsequent 
data  analysis. 

RICONNBHDBD  USBS 

TANDEMS  is  a  useful  laboratory  tool  for  assessing  decision  making 
performance  in  the  presence  of  various  stressors .  Stressors  related  to  the 
TANDEMS  task  (task-related  stressors) ,  as  well  as  stressors  peripheral  to  the 
TANDEMS  task  (ambient  stressors)  can  be  superin^osed  during  TANDEMS  use  in  order 
to  examine  their  impact  on  performance.  Questions  concerning  how  and  when 
stressors  iopact  performance,  differential  effects  of  task- related  and  ambient 
stressors,  cocig>ound  versus  individual  stressor  impacts,  and  stressor-exposure 
during  skill  acquisition  can  all  be  examined  within  the  TANDEMS  test  bed. 

CONCLUSIONS 

TANDEMS  provides  a  tool  for  examining  the  performance  impact  of  CIC-like 
stress.  The  similarity  of  cognitive  demands  and  information  processing 
requirements  between  operational  CICs  and  the  TANDEMS  test  facility  makes  TANDEMS 
a  useful  research  task  within  this  domain.  Research  from  the  TANDEMS  test  bed 
is  expected  to  provide  insights  into  techniqrues  for  minimizing  performance 
decrements  in  stressful  environments.  The  TANDEMS  facility  allows  the 
examination  of  several  critical  questions  about  decision  making  under  stress. 
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IMTRODOCTIOM 


PROBLBC 

As  modem  weapon  systems  push  the  technology  envelope  and  military  focus 
shifts  toward  the  crisis  and  limited  objective  warfare  (CALOW)  environment,  team 
members  are  often  placed  in  precarious  positions  requiring  the  rapid  processing 
and  synthesis  of  vast  amounts  of  data  before  decisions  cam  be  reached  (Coovert, 
Cannon -Bowers,  &  Salas,  1990;  Driskell  &  Salas,  1991a,  1991b) .  When  the  amount 
of  data  that  must  be  processed  exceeds  the  information  processing  capacity  of  the 
individual,  performance  breaks  down.  In  addition  to  the  technological 
sophistication  of  equipment  and  demanding  CALOW  situations,  the  stress  resulting 
from  factors  such  as  time  compression,  information  ambiguity,  fatigue,  and 
command  pressure  may  contribute  to  inaccurate  data  assessment,  erroneous 
conclusions,  and  slow  or  faulty  decisions  •  all  of  which  can  lead  to  disastrous 
consequences  in  the  operational  environment  (Cannon -Bowers  &  Salas,  1990;  Cannon- 
Bowers,  Salas,  &  Grossman,  1991)  . 

In  an  attenpt  to  minimise  performance  degradation  in  stressful  environments, 
the  Office  of  Haval  Technology  (ONT)  initiated  the  TActical  decision  {jaking  Under 
Stress  (TADMUS)  program.  The  ultimate  goal  of  this  effort  is  to  develop 
principles  and  strategies  for  both  training  and  decision  support  systems  which 
will  maximise  performance  in  such  environments.  While  the  TADMUS  program  is  a 
multi-year,  protracted  effort,  one  element  of  this  program  involves  the 
establishment  of  an  eiqperimental  test  facility  to  conduct  a  systematic  series  of 
experiments  designed  to  examine  individual  and  team  performance  under  stress. 
While  high  fidelity  facilities  may  be  essential  for  understanding  complex 
operational  team  processes,  there  is  a  need  to  have  theoretically-based, 
operationally -re levant  tasks  that  allow  better  experimental  control  within  the 
laboratory  context.  A  review  of  the  literature  showed  that  no  testbed  facilities 
existed  which  would  provide  the  type  of  tasks  relevemt  to  the  environment  we 
desired.  What  was  needed  was  a  facility  which  provided  a  level  of  versatility 
in  terms  of  continuous  availeUsility,  rapid  scenario  creation,  automated 
performance  measurement,  experimental  control,  and  tasks  representative  of  those 
occurring  in  Combat  Information  Centers  (CIO  .  Consecjuently,  the  ^ctical  Uaval 
DBcision  leaking  System  (TANDEMS)  was  developed  to  meet  these  needs. 

PURPOSE 

The  purpose  of  this  report  is  to  describe  TANDEMS,  dociiment  its  development, 
and  describe  several  research  opportunities  that  will  be  pursued  using  TANDEMS. 

SCOPE 


Although  TANDEMS  is  designed  to  be  used  in  either  a  team  or  individual  user 
mode,  this  report  describes  the  system  only  from  the  individual  user  perspective. 
The  team  mode,  while  very  similar  to  the  individual  mode,  will  be  addressed  in 
a  separate  report. 
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OROAMIRATIOM  OP  TRK  REPORT 

Poliowing  this  introduction,  this  report  describes  the  approach  taken  in 
developing  TANDEMS,  provides  a  system  description,  addresses  research 
opportunities,  and  presents  conclusions. 
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APPROACH 


THBORBTXCAL  BASIS 

Most  of  the  theoretical  explanations  of  human  information  processing  rest 
upon  the  fundamental  notion  of  a  finite  attentional  resource  pool  (Cohen,  1978; 
Pisk  &  Schneider,  1981;  Glass  &  Singer,  1972;  Kahneman,  1973;  Kanfer  &  Ackerman, 
1989;  Shiffrin  &  Schneider,  1977)  .  Provided  that  the  quauitity  of  information 
that  must  be  processed  remains  within  the  bounds  of  this  attentional  resource 
pool,  individuals  are  generally  able  to  cope  and  maintain  task  performance. 
However,  when  the  amount  of  information  that  must  be  processed  and  synthesized 
exceeds  the  resource  pool's  capacity,  individuals  may  not  be  able  to  adequately 
handle  all  of  the  data.  Ensuing  performance  decrement  would  then  be  expected. 

One  conceptualization  of  information  processing  is  Shiffrin  and  Schneider' s 
(1977)  notion  of  automatic  and  control  processing.  The  theory  contends  that 
individuals  assimilate  information  through  automatic  or  control  processes.  In 
essence,  automatic  processes  are  attention- free .  They  are  the  methods  used  for 
dealing  with  highly  consistent,  routine  operations.  In  order  for  a  task  to  be 
performed  \inder  an  automatic  processing  mechanism,  a  large  number  of  repetitions 
is  usually  required  during  skill  acquisition.  Control  processes,  on  the  other 
hand,  are  activated  for  new  or  une^qjected  operations .  'The  control  process 
mechanism  places  significant  demands  on  the  individual's  attentional  capacity  if 
successful  performance  is  to  result.  This  distinction  between  automatic  and 
control  processing  is  important  from  a  training  perspective.  Skilled  individuals 
would  be  less  vulnerable  to  attention -demanding  distractions  (such  as  stressor 
presence)  because  the  attentional  drain  inposed  would  not  affect  the  relatively 
attention  free  automatic  processes,  unskilled  individuals,  on  the  other  hand, 
would  be  more  prone  to  outside  influences  because  of  their  greater  reliance  on 
control  processing  and  the  resultant  competition  for  attentional  resources. 

TANDEMS  provides  a  means  for  examining  how  performance  at  different  levels 
of  proficiency  is  affected  by  the  presence  of  such  stressors  as  workload  and 
ambiguity.  During  the  early  stages  of  use,  when  users  are  operating  under 
control  processes  and  demands  on  attentional  resources  are  high,  introducing 
stressors  might  be  expected  to  contribute  to  performance  decrement  (Shiffrin  & 
Schneider,  1977) .  However,  when  users  become  more  highly  proficient  and 
automatic  processes  are  operating  to  control  performance,  a  stressor  intervention 
should  not  have  the  same  decremental  impact  as  in  the  case  of  the  control  process 
mechanism  since  more  of  the  attentional  resource  pool  is  available  for  dealing 
with  the  stressor  (Fisk  &  Schneider,  1981) .  It  is  within  this  context  that 
TANDEMS  serves  as  a  useful  tool  for  exeunining  performance  under  stress . 

DEVELOPMENT  RATIONALE 

Interviews  with  fleet  and  training  personnel,  as  well  as  observations  of 
underway  CIC  teams  provided  the  basis  for  the  TANDEMS  testbed.  The  types  of 
tasks  performed  by  team  members,  the  ambiguity  and  often  conflicting  nature  of 
information,  and  the  fast-paced  and  dynamic  environment  of  CIC  operations  were 
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captured  and  incorporated  within  TANDEMS.  Based  on  a  review  of  CIC  operations, 
several  requirements  were  identified  for  the  tasks  which  were  to  be  represented 
within  TANDEMS  (Department  of  the  Navy,  1989)  . 

First,  the  task  had  to  represent  accurately  the  cognitive  and  information 
processing  demands  of  various  positions  within  an  actual  CIC.  For  example,  a 
number  of  different  parameters  are  often  simultaneously  considered  in  deciding 
the  identity  of  a  given  contact.  Thus,  access  to  multiple  information  parameters 
was  a  design  feature  that  was  required  to  be  incorporated  in  TANDEMS  in  order  to 
reflect  this  level  of  information  processing  (see  also  Zachary,  Zaklad, 
Hicinbothom,  Ryder,  Purcell,  &  Wherry,  1991) . 

Second,  conflicting  and  ambiguous  data  often  appear  on  various  displays 
within  the  CIC.  The  ambiguity  may  be  the  result  of  equipment  degradation, 
unavailable  data,  interfer>ince,  erroneous  interpretation,  or  other  factors.  The 
operator  must  observe  that  certain  information  is  ambiguous  (or  conflicts  with 
other  information) ,  weigh  that  information  in  the  context  of  other  availadile 
data,  and  decide  on  its  utility  before  taking  em  action  that  is  based  on  that 
information.  Within  TANDEMS,  the  capability  to  present  ambiguous  and  conflicting 
information  to  the  user  was  addressed  by  providing  a  means  in  which  certain 
parameters  (data)  accessed  by  the  user  can  be  made  to  directly  conflict  with 
other  parameters. 

Third,  workload  often  varies  during  CIC  operations  (Zachary  et  al . ,  1991) . 
At  the  extreme,  the  operator  must  deal  with  large  numbers  of  fast-moving, 
potentially  hostile  contacts  that  pose  serious  threats.  The  ability  to  determine 
whether  am  unknown  contact  is  friendly  or  hostile  within  this  type  of  environment 
was  deemed  critical  and  therefore  became  a  TANDEMS  design  requirement. 

Finally,  from  the  user's  perspective,  a  user-friendly  interface  an  exercise 
generator,  an  automated  performance  measurement  system,  and  a  data  recording 
facility  were  required  for  efficient  system  operation.  TANDEMS  was  designed  to 
meet  all  of  these  requirements. 

TASK  CHARACTERISTICS 

The  CIC  is  the  "nerve  center"  of  all  surface  combatants.  It  is  the  location 
in  which  sensor  data  are  displayed  and  analyzed,  weapon  control  systems  are 
manned  and  operated,  command  and  control  functions  are  performed,  and  most 
tactical  decisions  are  made.  In  short,  it  is  the  data  fusion  center  of  the  ship. 

The  manning  of  a  CIC  is  a  function  of  both  ship  type  (platform)  euid  mission. 
Consequently,  the  specific  pool  of  tasks  performed  may  vary  across  platform 
types.  Nevertheless,  there  are  several  characteristics  and  tasks  that  are  common 
to  all  CICs.  First,  the  main  ingredient  of  the  CIC  is  the  team.  It  is  not  a 
group  of  independent  individuals  working  in  isolation,  but  rather  it  is  an 
interdependent  group  working  in  unison  toward  some  common  goal  that  constitutes 
the  essence  of  a  CIC  team. 
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Second,  under  the  Navy's  Composite  Marfare  Command  (CWC)  doctrine,  CIC  teams 
are  partitioned  into  subteams  who  specialize  in  functionally  different  warfare 
areas  (Department  of  the  Navy,  1985) .  Although  the  ioqportance  of  these  areas 
varies  as  a  function  of  mission,  anti-air  warfare,  anti-surface  warfare,  and 
anti-submarine  warfare  areas  are  common  to  all  CICs. 

Third,  each  of  the  subteams  is  made  up  of  individuals  who  must  focus  on  both 
taskwork  and  teamwork  aspects  of  their  job  in  order  for  the  team  to  perform 
^timally.  Errors  committed  by  individuals  at  this  lowest  level  of  the  team  have 
the  potential  to  propagate  themselves  throughout  the  teamwork  system. 
Consequently,  performance  at  the  individual  level  is  crucial  to  ultimate  team 
outcomes . 

finally,  tactical  performance  is  built  around  the  premise  that  there  are 
five  basic  functions  of  the  CIC:  detecting,  tracking,  identifying  contacts, 
acting  on  those  contacts,  and  performing  battle  damage  assessment  in  the  event 
of  weapons  release.  To  the  extent  that  these  functions  are  performed  well,  the 
CIC  team  is  doing  its  job.  Three  of  these  functions  -  detecting,  identifying, 
and  acting  -  are  intentionally  designed  into  TANDEMS  in  order  to  represent  the 
types  of  tasks  performed  in  actual  CIC  operations. 
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SYSTSM  OBSCRIRTZON 


OVBRVZBW 

TANDEMS  represents  selected  functions  performed  by  CIC  personnel.  It  is  PC- 
based,  written  in  the  programming  language,  and  hosted  in  a  MS  DOS 
environment.  TANDEMS,  which  was  developed  by  the  Naval  Training  Systems  Center, 
is  configurable  for  team  or  individual  operator  use  and  can  be  set  up  for  novice, 
apprentice,  or  journeymen  users.  System  requirements  include  a  640x480  VQA 
graphics  capability,  a  20  megab^'te  hard  drive,  640  kilobytes  of  random  access 
memory  (RAM),  a  Logitech  3 -button  trackerball  with  a  4.01  driver,  and  MS  DOS 
version  3.3  or  later.  The  TANDEMS  software  cam  be  loaded  from  a  5.25"  or  3.5" 
disk  using  an  embedded  installation  program. 

A  sample  TANDEMS  screen  is  presented  in  Figure  1.  On  the  left  side  of  the 
PC  monitor,  the  system  presents  radar- like  contacts  (blips)  on  a  simulated  radar 
display.  The  right  side  of  the  screen  presents  selectable  on-screen  menus  that 
allow  users  to  access  information  necessary  to  Identify  the  contact's  platform 
type  (aircraft,  ship,  or  submarine)  and  classification  (friendly,  unknown,  or 
hostile)  .  The  menus  are  labeled  A,  B,  and  C.  As  the  user  selects  one  of  the 
menus  via  a  trac)cball  and  crosshair,  textxial  information  located  within  the  menu 
is  made  available  to  the  user  in  a  series  of  information  fields.  By  reviewing 
the  contents  of  these  information  fields  and  con^^aring  them  to  a  set  of  decision 
rules,  the  user  will  be  in  a  position  to  identity  and  label  radar  contacts  and 
to  take  appropriate  action  with  respect  to  each  contact.  The  system  is  composed 
of  three  primary  modules  •  the  Exercise  Generation  System,  the  Execution  (run) 
System,  and  the  Performance  Measurement  System  -  each  of  which  will  be  discussed 
below. 

THE  BZBRCZSB  OENBRATZON  SYSTBN 

The  Exercise  Generation  System  provides  the  capability  for  creating 
scenarios  on  TANDEMS.  Essentially,  the  "author"  of  these  exercises  specifies  the 
type  and  numJcer  of  contacts  that  will  appear  in  an  exercise,  the  difficulty  of 
the  exercise,  the  text  strings  to  be  used  in  the  various  information  fields,  and 
how  the  information  fields  are  to  be  allocated  to  the  three  menus. 

The  author  can  select  among  six  different  types  of  contacts  for  the  radar 
screen:  air  friendly,  air  hostile,  surface  friendly,  surface  hostile,  submarine 
friendly,  and  submarine  hostile.  Once  one  of  these  six  options  is  selected,  the 
author  then  specifies  the  number  of  contacts  desired.  A  maximum  of  99  contacts 
can  be  specified  across  these  six  contact  types.  TANDEMS  then  randomly  generates 
the  specified  number  and  type  of  contacts  for  display  on  the  radar  screen. 
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During  the  specification  process,  TANDEMS  also  queries  the  author  for  the 
desired  difficulty  level  associated  with  each  contact  type.  Options  include 
"easy, "  where  each  information  field  associated  with  a  contact  provides  totally 
accurate  data;  "ambiguous,"  in  which  a  small  percentage  of  the  data  in  the 
information  fields  contains  inconsistent  information  with  respect  to  data  in 
other  information  fields;  and  "conflicting,"  whereby  a  larger  percentage  of  the 
data  in  the  information  fields  provides  information  in  direct  contrast  to  data 
in  other  related  information  fields.  In  all  cases  however,  the  majority  of  the 
information  fields  provide  sufficient  data  to  reach  a  correct  decision. 

Next,  the  author  must  select  the  text  strings  to  be  used  in  each  of  the 
information  fields.  This  decision  would  be  a  function  of  user  expertise,  ranging 
from  novice,  through  apprentice,  and  up  to  journeymen.  The  changes  in  the  text 
strings  across  these  levels  use  very  siople,  descriptive  text  for  novices, 
progressing  through  more  operational  jargon  or  code  words  for  journeymen. 

Finally,  the  author  must  also  allocate  the  various  information  fields  to 
each  of  the  three  menu  "slots"  •  designated  as  A,  B,  and  C.  (A  fourth  menu  slot, 
labelled  OP  for  operator,  controls  the  exercise  via  start,  pause,  and  shutdown 
system  functions)  .  Presently,  four  information  fields  pertain  to  platform  type: 
speed,  signal  strength,  initial  altitude /depth,  and  initial  climb/dive  rate. 
Seven  fields  relate  to  classification:  bearing,  range,  electronic  warfare,  threat 
level,  direction  of  origin,  countermeasures,  and  intelligence.  Several  fields 
contain  "administrative"  functions:  changing  range  scale,  changing  symbols, 
performing  final  engagement,  hooking  contacts,  and  so  on.  As  an  example,  the 
four  fields  related  to  identifying  platform  type  might  be  placed  in  menu  A,  the 
seven  fields  pertaining  to  classification  might  be  located  in  menu  B,  and  the 
remaining  information  fields  might  be  positioned  in  menu  C.  Up  to  15  information 
fields  can  be  placed  in  any  of  the  three  menu  slots.  The  point  is  that  the 
author  is  free  to  intermix  the  information  fields  in  any  configuration  desired 
across  the  three  menu  slots . 

THB  BXBCOTZOM  SYSTEM 

After  the  exercises  have  been  generated,  users  run  the  exercises  through  the 
Execution  System.  An  exercise  is  selected  by  name  from  a  scrolling  window  of 
existing  exercises.  Once  an  exercise  is  selected,  the  scenario  begins. 
Initially,  all  contacts  are  presented  as  non- labelled,  generic  "blips"  of  unknown 
platform  type  and  classification.  The  user's  task  is  to  collect  enough  data  from 
the  information  fields  within  each  menu  to  determine  each  contact's  platform  type 
(aircraft,  ship,  or  submarine) ,  and  classification  (friendly,  unknown,  or 
hostile) .  Thus,  there  are  nine  different  labels  that  c«ui  be  assigned  to  each  of 
the  contacts  (e.g.,  air  friendly,  surface  hostile,  etc.) .  To  access  information, 
the  user  must  first  "hook"  (select)  a  contact  by  either  using  the  trackball  to 
position  a  crosshair  on  a  contact  auid  clicking  the  left  trac)d}all  button,  or  by 
selecting  a  field  within  one  of  the  menus.  The  hooked  contact  becomes  the 
selected  target  and  all  information  gleaned  from  the  information  fields  in  each 
menu  relates  specifically  to  that  contact.  The  exercises  are  supported  by  a 
paper-based  set  of  decision  rules  (see  Table  1)  that  identify  how  the 
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Table  1 

TAMDDtS  Deei.iiion  Rulae 


PLATFORM  TYPE 

Information  Field 

AIR 

Speed 

>  3S  knots 

0-35  knots 

0-35  knots 

Altitude /Depth 

>  0  ft. 

0  ft. 

<  0  ft. 

Climb/Dive  Rate 

+/-10O-SO0'/m  O'/m 

+/-100-500' /m 

Signal  Strength 

Medium 

High 

Low 

CLASSIFICATION 

Intgnnfltion  Fisld 

PRIBMPItY 

OMRMQWH 

hostile 

Initial  Bearing 

091-270 

271-359 

000-090 

Initial  Range 

0-20nffl 

21*100nm 

>  lOOnm 

Countermeasures 

None 

Unknown 

Jamming 

Blectronie  Warfare 

None 

Undetected 

Big  Bulge  Radar 

Threat  Level 

1 

2 

3 

Intelligence 

US /Ally 

Unavailable 

Suspected  Hostile 

Dir.  of  Origin 

Blue  Lagoon 

Un)cnown 

Red  Sea 

information  in  each 

information  field  should  be  interpreted. 

The  user's  task. 

then,  is  to  learn  to  tap  the  relevant  information  fields  quickly  and  accurately, 
to  interpret  the  information  correctly  in  those  fields,  to  label  each  contact  in 
the  exercise  rapidly,  and  to  perform  a  "final  engagement”  (select  shoot  or  clear) 
for  each  contact.  As  such,  the  task  is  representative  of  functions  performed  in 
actual  CICs  along  the  dimensions  of  fleet  practices.  Specifically,  users  must 
detect  contacts  on  the  radar  display,  review  information  to  identify  and  label 
contacts,  and  act  upon  each  contact  that  appears  on  the  display. 

TBS  PBRFORIIAMCB  KBASORDIBNT  SYSTKN 

The  Performance  Measurement  System  contains  the  data  files  for  automatically 
capturing  and  recording  user  performance  measures.  User  records  are  keyed  by  a 
three-digit  user  identification  number  emd  a  two-digit  designator  depicting  the 
experimental  condition.  Performance  measures  in  seven  areas  are  recorded  for 
each  user  and  each  exercise.  The  performance  measures  that  are  recorded  are 
defined  below: 


20 


Special  Report  92*002 


(1)  Hook  Time  -  Thle  is  a  meaeure  of  the  time  from  when  a  contact  is 
first  hooked  until  it  is  "shot"  or  "cleared".  T^ie  time  is  interrupted  if  a  new 
contact  is  hooked,  and  then  resumed  whan  re -hooked.  It  is  accurate  to  0.01 
seconds . 


(2)  T*r*  *  The  four  platform  type  information  fields  and  the 
seven  classification  information  fields  are  referred  to  as  critical  information 
fields.  They  contain  the  information  upon  which  decisions  can  tae  made.  The 
information  within  these  fields  can  be  read  only  when  the  trackball  button  is 
depressed  and  held  down.  The  time  spent  accessing  information  in  these  critical 
fields  is  recorded  by  measuring  how  long  the  trackball  button  is  depressed  when 
a  critical  field  is  accessed.  It  is  recorded  to  the  nearest  0.01  seconds. 

(3)  Accuracy  -  This  measure  reflects  the  percentage  of  all  contacts 
in  a  given  exercise  that  were  correctly  laibelled  engaged. 

(4)  Critical  Item  Access  -  This  measure  indicates  the  number  cf  times 
the  user  accessed  any  of  the  eleven  critical  information  fields.  Button  presses 
less  than  .25  seconds  are  considered  inadvertent  clicks  and  are  not  counted  in 
this  measure. 

(5)  of  avabol  Changes  -  Users  are  free  to  chauige  the  symbol 
(e.g.,  surface  friendly)  that  they  place  on  a  contact  as  many  times  as  desired. 
However,  once  the  final  engagement  (shoot/clear)  is  executed,  the  contact 
disappears  from  the  screen  and  no  further  action  is  allowed.  The  number  of  times 
a  symix>l  is  changed  by  the  user  before  final  engagement  is  recorded  as  this 
measure . 


(6)  Final  Percentage  Inaaaed  -  This  measure  is  the  percentage  of 
contacts  for  which  the  user  has  executed  a  final  engagement. 

(7)  TgtWl  Tint  ~  This  measure  reflects  the  total  amount  of  time  that 
has  elapsed  from  beginning  of  the  scenario  until  the  last  contact  has  been  shot 
or  cleared. 

All  data  generated  in  the  report  generator  are  sa'<'ed  in  a  format  amenable 
to  data  analysis. 
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TRZS  RAOS  Z1ITB1ITIONAZ.LY  LEFT  BUOIK 
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RISBARCR  OPRORTDMZTIBS 

TANDBNS  offers  many  research  opportunities  for  examining  the  in^licacion  of 
performance  under  varying  workload  and  uncertainty  conditions  and  for  studying 
the  impact  of  training  interventions  on  performance.  No  doubt,  there  are  many 
dooiains  worthy  of  study  within  this  context  (see  Cannon-Bowers  et  al.,  1991). 
Presented  below  is  a  sao^le  of  several  of  these  areas. 

TASK  VS.  AMBZntT  STUSSORS 

TANDEMS  can  be  readily  used  in  a  controlled  laboratory  environment  as  a  test 
bed  to  support  ej^eriments  on  human  decision-making  performance.  The  primary 
focus  is  on  the  impact  of  various  CZC-like  stressors  on  decision  making 
performance.  For  exao^le,  the  intact  of  task- related  and  ambient  stressors  on 
performance  as  proposed  by  Driskell  et  al.  (1991)  provides  a  basis  for 
generating  testable  hypotheses  for  this  research.  Task- related  stressors  refer 
to  stressors  inherent  in  the  primary  task  that  is  being  performed.  Bxan^les 
would  include  such  variables  as  workload,  time  pressure,  information  ambiguity, 
and  task  difficulty.  Ambient  stressors,  on  the  other  hand,  refer  to  those 
stressors  which  are  not  part  of  the  primary  task  per  se,  but  exist  within  the 
peripheral  environment  and  cannot  be  ignored  by  the  user.  They  would  include 
variables  such  as  auditory  or  visual  distractions,  peripheral  (secondary) 
tasking,  and  evaluation  apprehension  (command  pressure) . 

Within  this  context,  a  variety  of  research  issues  can  be  examined.  For 
exan^le,  it  would  be  useful  to  examine  the  differential  effects  of  task-related 
and  ambient  stressors  on  task  perfornuuice .  To  date,  it  is  not  clear  if  these  two 
types  of  stressors  influence  performance  in  the  same  manner.  Also  useful  would 
be  a  study  of  how  stressor- induced  performance  affects  different  points  in  user 
proficiency.  For  exan^le,  it  may  be  that  as  skirls  become  more  robust  and 
automatic  processes  are  governing  performance,  individuals  may  be  better  able  to 
tolerate  stressor  presence  than  when  skill  acquisition  is  still  occurring  and 
control  processes  are  operating.  A  related  enpirical  issue  would  be  whether  the 
effects  vary  across  user  proficiency  levels  (e.g.,  novices  vs.  apprentices  vs. 
journeymen) . 

8KII.L  ACQDXSXTZOM 

A  program  of  research  by  Friedland  and  Keinaui  (Friedland  &  Keinan,  1982, 
1986;  Keinan,  1988;  Keinan  6  Friedland,  1984)  has  focused  on  the  acquisition  of 
skills  under  various  techniques  which  couple  training  and  stressor  presence. 
While  they  have  offered  many  suggestions  on  how  to  best  configure  skill 
acquisition  with  stressor  presence  in  order  to  foster  successful  performance 
under  stress  in  criterion  situations,  most  of  their  research  has  focused  on 
relatively  simple,  paper -and -pencil -based  pattern  recognition  tasks.  TANDEMS 
provides  a  mechanism  for  testing  their  findings  in  a  context  more  closely  aligned 
with  military  tasks. 
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As  an  axaopla,  one  interaating  hypothaais  concerns  the  examination  of 
whether  the  introduction  of  atreasors  during  the  later  stages  of  skill 
acquisition  will  bolster  later  performance  on  subsequent  criterion  tests.  In 
other  words,  if  stressors  are  introduced  during  training  at  a  point  after  the 
skills  have  been  acquired,  will  this  introduction  of  stressors  facilitate 
subsequent  performance  in  stressful  situations.  Relatedly,  it  may  also  be 
interesting  to  determine  whether  any  facilitativa  effects  of  eiqposure  to  one  set 
of  streaaors  during  training  will  generalise  to  a  criterion  condition  in  which 
a  novel  set  of  stressors  is  presented.  To  date,  this  has  not  been  presented  in 
the  literature. 

8TRISS  KXROSPmt  TRAXHXIIO 

Meichenbaum  (1985)  has  devised  a  three -step,  phased  approach  for  training 
stress  coping  skills.  The  intent  is  to  teach  techniques  for  managing  counter¬ 
productive  effects  of  stress  so  that  task  performance  can  be  maintained,  within 
the  TAIMDS  program,  Hall,  Driskell,  Salas,  and  Camnon -Bowers  (1992)  have 
specified  design  guidelines  for  stress  es^osure  training.  These  guidelines 
lie  in  the  domains  of  needs  analysis,  fidelity,  sequencing,  evaluation,  and 
feedback.  TAMDBMS  will  be  used  as  a  test  bed  for  testing  and  refining  these 
guidelines  as  well  as  for  testing  the  overall  benefits  of  stress  eiqposure 
training . 
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COHCIiUSZOMS 

TANDEMS  lends  itself  well  to  examining  the  types  of  enpirical  issues  raised 
earlier.  Although  the  physical  fidelity  of  TANDEMS  relative  to  the  operational 
environment  is  low,  functional  fidelity  is  high.  TANDEMS  users  will  be  presented 
with  similar  cognitive  demands  and  information  processing  requirements  as  in  an 
actual  CZC  environment,  thus,  face  validity  and  user  acceptance  should  be  high. 

Because  of  its  game-like  format,  the  scoring  consonant  and  inherent 
challenge  should  make  it  motivational  for  users.  Also,  exercise  generation, 
automated  performance  measurement,  and  data  recording  make  it  an  efficient 
facility  for  researchers.  Data  records  are  kept  in  an  ASCII  format  for  ease  of 
use  with  off-the-shelf  statistical  analysis  packages. 

In  summary,  TANDEMS  is  a  versatile  tool  for  examining  the  performaince 
inpacts  of  stress.  It  is  anticipated  that  the  results  of  various  eiqperiments 
will  shed  light  on  how  users  are  affected  when  various  stressors  are  present,  and 
that  this,  in  turn,  will  have  inplications  for  instructional  strategies  aimed  at 
ameliorating  stress -produced  performance  decrement. 
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